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Abstract 

Orthogonal  functions,  and  in  particular.  Walsh  functions,  have 
been  advocated  in  the  literature  as  a  method  of  approximating  the 
solutions  of  singular  systems  Ex'  =  Fx  +  Bu  of  index  k.  This  paper 
gives  the  first  analysis  of  the  accuracy  of  these  approximations.  For 
Walsh  functions,  divergence  is  shown  for  >  3  and  convergence  for 
=  0, 1.  The  index  two  case  is  also  analyzed. 
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1  Introduction 

The  singular  control  system 

Ex'(t)  -  Exit)  +  Buit),  x{to)  =  xq  (1) 

with  E,  F,  B  constant  matrices  and  E  singular,  has  been  extensively  studied 
[2], [3], [8].  In  [11]  it  was  suggested  that  (1)  could  be  solved  using  orthogonal 
functions.  This  was  discussed  further  in  [4], [10], [9].  These  papers  con¬ 
sidered  Walsh  functions  because  of  their  simple  structure  and  the  ease  of 
approximating  coefficients.  While  these  papers  showed  that  one  could  solve 
the  resulting  algebraic  equations  for  the  coefficients  of  an  approximation, 
none  of  them  actually  examined  how  good  these  approximations  were.  In 
this  paper  we  shall  give  the  first  discussion  of  the  convergence  of  the  Wakh 
approximations  for  singular  systems.  It  will  be  shown  that  in  many  cases 
the  approximations  actually  diverge  from  the  true  solutions  as  more  terms 
are  used  in  the  approximation. 

2  Orthogonal  Approximations 

Suppose  that  E,F  are  n  x  n  and  that  (1)  is  solvable.  That  is,  XE  -f  F  is 
a  regular  pencil  so  that  det(A£'  F)  ^  0  and  (1)  has  a  solution  for  every 
sufficiently  smooth  u  amd  for  consistent  xq  [2].  We  consider  read  E,  F,  B,  x,  u 
but  the  complex  case  is  similar. 

To  simplify  notation,.  In  order  to  explaun  our  analysis  we  need  to  in¬ 
troduce  some  notation  and  review  some  terminology  from  the  theory  of 
orthogonad  functions.  Let  be  the  space  of  adl  square  integrable  lebesque 
measurable  functions  on  [0, 1].  is  a  Hilbert  space  with  inner  product. 


and  associated  norm 
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A  vector  vadued  function  will  be  said  to  be  in  if  each  coordinate  is.  Let 
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(4) 


^  orthonormal  basis  for  £^.  Then  if  /  €  £^,  we  have 


/(O  =  £  f,Mi) 


where  the  fi  are  the  Courier  coeflScients  of  /  with  respect  to  the  basis 
The  series  (4)  converges  in  the  norm  (3).  For  a  given  orthonormal  basis 
{V’i},  let  =  [fki ,  ■  ■  ■ ,  i’mY'  define  the  projection  onto  the  span  of 
by 

Pm(/)=f;/.* 


Let  the  coeflBcients  of  this  projection  be  given  by  the  operator 


OnC/)  =  [/,,. ..,/m] 


For  a  vector  a  =  [oi, . . . , Om],  define 


^m(a)  =  X) 


If  /  is  ve  ttor  valued,  then  Cn(/)  is  a  matrix  whose  ij-th  entry  is  the  j-th 
Courier  cc  jfficient  of  the  i-th  element  of  /.  Similarly,  the  a,  in  the  definition 
of  Cm  can  be  vectors.  Note  that  Vm{f)  =  CmiD'^m-  Finally,  define  the 
m  X  m  matrix  Pm  by 


Cm  [£  4'm(5)ds)  =  Pm 


Now  we  can  consider  the  singular  system  (1).  Fix  m  and  take  X  = 
Cmix),U  =  Cm{it),Q  =  Cm(xo)  where  lo  is  considered  a  constant  function. 
Integrating  (1)  gives 


Ex(t)  —  Exq  =  F  f  x{s)ds  —  B  f  u(s)ds 
Jo  Jo 


Using  the  approximations  and  xq  =  in  (5)  gives 


EX'^f  -  EQ'H  =  FX  /'  \&(s)ds  -  BU  <il{s)ds 

Jo  Jo 


where  the  m  subscript  has  been  dropped.  Tadcing  Cm  of  both  sides  of  (6) 
amd  letting  P  =  Pm  yields  the  algebraic  equation 

EX -EQ  =  FXP  -  BUP  (7) 

In  the  method  of  orthogonaJ  functions,  (7)  is  solved  for  X  given  E,  F,  P,U,B. 
The  most  discussed  orthonormal  basis  to  date  have  been  the  Wadsh  func¬ 
tions  [5],  [9], [10], [13].  If  m  =  2-',  however,  the  span  of  the  first  m  Walsh 
functions  is  identical  to  the  linear  span  of  the  m  block-pulse  functions 
where  ^{t)  islif^<<<;^  and  0  otherwise.  The  set 
is  orthogonal  amd  can  be  normalized  by  multiplying  by  y/m.  Let 
Notice  that  the  are  not  am  orthonormad  basis  for  C^.  Rather 
for  m  —  y,  the  , . . . ,  is  an  orthonormad  basis  for  the  span  of  the  first 
m  Walsh  functions.  Thus  we  get  approximations  with  the  same  error  using 
either  set  of  m  functions  and  the  linear  adgebra  problem  (7)  has  the  same 
numericad  conditioning  in  both  cases.  That  (7)  has  a  solution  is  shown  in 
[9].  We  aue  interested  in  the  accuracy  of  the  approximation  to  the  solution 
X  given  by  the  solution  X  of  (7). 

Using  the  standard  structure  theory  for  matrix  pencils  [2], [8],  we  can 
transform  (1)  by  constant  coordinate  chamges  into 

z[  =  Czi  +  Biu  (8) 

Nzlj  =  Z2-^  B2U  (9) 

where  N  is  nilpotent  of  index  k.  That  is,  N'’  —  0,  ^  0.  Similarily,  (7) 

will  decouple  into  two  equations,  one  for  the  coefficients  of  zi  and  one  for  the 
coefficients  of  Z2.  Let  h  —  i/m.  It  is  known  that  the  Walsh  functions  will 
give  am  0{h)  appraximation  for  (8).  We  consider  then  only  (9).  Additional 
coordinate  chamges  on  (9)  will  put  N  into  Jordan  form  and  decouple  (7) 
so  that  the  subsystems  may  be  considered  separately.  Thus  there  is  no 
loss  of  generality  in  assuming  that  (1)  is  in  the  form  of  (9)  where  TV  is  an 
elementary  Jordan  block  of  index  k.  We  now  carefully  consider  the  index 
3  case. 

Example  1.  Consider  (1)  where 
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u  =  1  +  4i  -  3<^  -  2e‘ 


This  system  has  the  solution 


jv\  :v-v.  V.  i^r. 


'  Xi  ■ 

■  1  +  2t  +  ZP  +  6e‘  ■ 

X  = 

X2 

= 

2t  +  +  4e‘  -  5 

.  . 

.  ZP  +  2e'  -  4<  -  1  . 

The  resulting  equation  (7)  was  solved  using  the  numericzdly  robust  Bartels- 
Stewart  algorithm  [1],[6],[7].  Table  1  gives  the  error,  ||r  —  jr,„(X)||,  for 
several  values  of  m. 


m 

Xl 

X2 

X2 

4 

12.67 

0.954 

0.259 

8 

24.79 

0.478 

0.131 

16 

49.34 

0.239 

0.065 

32 

98.57 

0.119 

0.032 

64 

197.09 

0.059 

0.016 

Table  1.  error  for  Example  1 


From  this  table  we  observe  what  appears  to  be  0{h)  convergence  in  X2  and 
Xa  and  0(  j)  divergence  in  Xj .  The  convergence  in  Z2  was  surprising.  We 
had  expected  the  error  in  approximating  X2  to  be  0(1).  To  understand  the 
convergence  for  the  X2  variable  and  to  show  that  the  observed  behavior  of 
this  example  reflects  the  general  case,  we  shall  consider  this  example  more 
carefully.  For  the  block  pulse  functions, 


Pm  = 
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Substituting  the  values  of  E,  F,  P,  U,  B,  Q  from  Example  1  into  (7)  gives 


Xji  Xlm  Xll  ^ 

^31  ■  ^3m  Xjl  ®2m 

0  •  •  •  0  J  L  2:31  •  •  •  a^3m  J 


=  Wll 


^Im  ^  ^  921  '  ■  92m 

Ulm  +  931  •  •  •  93m 

[  0  •  •  •  0 


From  the  third  row  of  (10)  we  have 

“  [^31 1  •  •  •  1  2? 3^]  —  [^11 1  '  '  '  1  ^Im] 


But  the  exact  solution  is  13  =  — u.  Thus  the  algebraic  variable  X3  is  ap¬ 
proximated  to  the  same  accuracy  as  u  was  approximated  which  is  0(h). 
Now  for  X2  we  have 


[3^21 )  •  •  •  1  ^2m]  —  [^11 1  •  •  •  1  ^Im] 


([^31  ,  •  •  •  y  ^3m]  [?3l  I  •  *  •  j  93m])  (  2  ^ 


The  actual  solution  is  X2  =  X3  —  u  =  —o'  —  u.  Thus 


([X31,  •  •  •  .X3m]  -  [931 ,  •  •  •  ,  93m])  ( 


must  be  an  approximation  for  X3.  To  see  why  this  is  0(h)  even  though 
the  Euclidian  operator  norm  of  is  O(^),  let  r  be  a  function  oft  and 
g(t)  =  fg  r(s)ds.  Let  G  =  R  =  Cm(r)  with  respect  to  the  block  pulse 

functions.  Then 


Cm(g)  =  On  r(,)ds  \  =  {  [‘  Vm(r)ds)  +  On  [J\l  -  Vm)(r)di 


or 


G  —  RP  +  fn» 


and  flnadly 


GP“*  =  R  +  emP 


-1 


The  term  €mP~^  is  the  error  in  using  GP~^  as  an  estimate  for  R.  In  our 
example  we  have  that  r  =  x^,  g  =  xs  —  2:3(0)  and  G  =  [X31,  •  •  • ,  ^3m]  — 
[93i>  •  •  •  ,93m]-  It  is  not  clear  that  HPmC^mP"')!!  is  0(h).  Suppose  that 
r  has  slowly  varying  slope.  The  interval  [0, 1]  can  always  be  broken  into 
subintervals  on  which  this  is  true.  Then  a  straightforward,  but  tedious 
calculation,  shows  that  tm  looks  like  where  is  a  vector  of 

ones  auid  M  is  independent  of  m  and  hence  ||Pm(’>’m)||  = 

(Actually  the  entries  of  are  between  two  vectors  in  this  form.)  But 
f)jn  =  vP~^  is  a  vector  of  ones  and  minus  ones.  Thus 


||Pm(emP-‘)||  =  ||Pm(/l'*^'MT,„-P-‘)||  =  ||Pm  (6)||  =  2Mh 


as  was  observed  for  X2-  However,  this  error  term  gets  multiplied  again 
by  in  the  computation  of  the  estimate  for  xi  and  looks  like 

[1,3,5, . . .]  which  are  the  normalized  block  pulse  coefficients  of  a  function 


of  norm  0(^^).  Thus  for  x\  we  have 


=  2M/i‘P||P„«P-')||  =  2AM'PO(^)  =  0(j) 


as  observed. 


3  Discussion 


As  noted  earlier  the  example  studied  is  typical  of  all  systems  of  index  k  <Z. 
Also,  any  system  index  higher  then  3  must  contain  a  subsystem  of  index  3 
of  the  form  of  our  example.  Thus  we  can  make  the  following  conclusions 
about  the  use  of  Walsh  functions  on  singular  systems. 


1.  The  orthogonal  function  method  using  Walsh  functions  will  give  an 
0(/i)  approximation  for  systems  (1)  of  index  zero  or  one. 


i 


2.  The  method  will  diverge  for  singular  systems  of  index  greater  then 
two. 

3.  For  index  two  systems,  we  can  expect  0{b)  convergence.  However, 
this  depends  on  adgebrauc  catncellation  and  can  be  expected  to  be 
numerically  sensitive.  Also,  convergence  can  be  reduced  by  controls 
u  with  rapidly  changing  derivatives. 

The  difficulty  in  using  Walsh  functions  arises  because  of  the  integral 
approximation.  If  our  orthogonal  basis  had  the  property  that 

then  there  would  not  be  this  difficulty.  One  example  of  such  a  basis  is 
{cos  z,sina:,  cos  2a:,  sin  2i, . . .}  on  and  m  an  even  integer.  However, 

in  this  case  the  coefficients  are  much  more  difficult  to  compute. 

Even  if  (1)  is  a  system  on  which  the  method  of  orthogonal  functions 
using  Walsh  functions  may  work,  this  method  may  not  be  the  method  of 
choice  unless  there  is  some  particlar  need  or  reason  for  using  Walsh  func¬ 
tions.  Large  values  of  m  must  be  used  to  obtain  even  modest  accuracy. 
There  axe  several  alternatives  that  can  provide  higher  accuracy  at  substan¬ 
tially  less  cost.  Among  these  are  computation  of  part  of  the  matrix  pencil 
[15], [7],  backward  differentiation  formulas  [14],  and  implicit  Runge  Kuttas 
[12]. 
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